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We present PackLib 2 , the first fully integrated benchmark library for multi-dimen- 
sional packing instances. PackLib 2 combines a systematic collection of all benchmark 
instances from previous literature with a well-organized set of new and challenging 
large instances. The XML format allows linking basic benchmark data with other 
important properties, like bibliographic information, origin, best known solutions, 
runtimes, etc. Transforming instances into a variety of existing input formats is 
■ also quite easy, as the XML format lends itself to easy conversion; for this purpose, 

^sD . a number of parsers are provided. Thus, PackLib 2 aims at becoming a one-stop 

location for the packing and cutting community: In addition to fair and easy com- 
• parison of algorithmic work and ongoing measurement of scientific progress, it poses 

. numerous challenges for future research. 
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1 Introduction 



A crucial feature of most important real-world operations research problems 
is that they tend to be computationally hard: It is highly unlikely that there 
exists an "ideal" algorithm that will construct a provably optimal solution in 
relatively short time, no matter what instance it is faced with. Fast and easy 
heuristics may return solutions that are quite poor for "difficult" instances; 
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even sophisticated methods that are guaranteed to find an optimum may re- 
turn a solution only after prohibitively long time. Nevertheless, such difficult 
problems need to be dealt with, so algorithms have to be constructed, tested, 
improved and compared. 

A natural approach for evaluating the practical performance of solution meth- 
ods is to run experiments on test instances. This is even true for problems 
that allow a theoretically "good", i.e., polynomial, algorithm, as this does 
not guarantee a useful running time in practical applications. Obviously, the 
choice of test instances may have a crucial impact on the results of such ex- 
periments, and comparisons between alternative approaches are only possible 
when similar test instances are used. Finally, beyond the performance of indi- 
vidual algorithmic implementations, keeping track of scientific progress over 
time is of vital interest for a research community. This makes it also desirable 
to maintain a canon of open challenge problems that can serve as catalysts 
for future developments. 



2 Benchmark Libraries 

A well-established answer to the demands described above is establishing and 
maintaining benchmark libraries for a large variety of problems. In opera- 
tions research, one of the first such efforts was undertaken by Beasley with 
ORLIB [4], a collection of instances for 98 different classes of combinatorial 
optimization problems, ranging from airport capacity allocation problems to 
vehicle routing problems, and including many different cutting and packing 
instances. 

Arguably the most prominent of benchmark libraries for combinatorial op- 
timization is the TSPLIB [26] by Reinelt. As the name indicates, this col- 
lection is comprised of instances of the traveling salesman problem (TSP), 
even though there are also some instances of the capacitated vehicle routing 
problem. The TSPLIB has been extremely successful in various ways. Its in- 
stances have been used for a large variety of problems, e.g., for matching [10] 
or for finding long tours [15]. Moreover, solving a large, previously unsolved 
TSPLIB instance has become a major scientific achievement, requiring years 
of work by outstanding researchers and decades of CPU time, announced in 
newspaper headlines and in one case [1] recognized as work worthy of a Beale- 
Orchard-Hays Prize for Excellence in Computational Mathematical Program- 
ming. Clearly, the TSPLIB demonstrates that a benchmark library can be 
more than just a basis for runtime comparison of algorithmic code. 

Two other examples of benchmark libraries are the MIPLIB for mixed integer 
programming (presented by Bixby et al. [7]) that serves as a benchmark for 
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all modern integer linear programming solvers, and the SteinLib by Koch et 
al. [23] that clearly demonstrates the advances in preprocessing and exact 
solution methods for Steiner tree problems. 



3 Packing Problems 

Problems of cutting and packing are among the most important problems in 
both mathematical programming and real-world operations research. Even the 
basic one-dimensional versions of problems like bin packing and knapsack (dis- 
cussed and used as examples in any introductory course in optimization) are 
NP-hard, but are more or less well-understood by means of linear and integer 
programming. Multi-dimensional generalizations face additional difficulties, as 
a straightforward modeling as a compact integer linear program is no longer 
available (see Fekete and Schepers [18] for a discussion.) As demonstrated in 
this special issue (and its predecessors [12], [6], and [30]), this gives rise to a 
multitude of algorithmic approaches, dealing with a variety of problem vari- 
ants. But unlike the progress made for the TSP, the Steiner tree problem, and 
for one-dimensional packing problems, solution methods for multi-dimensional 
packing problems have failed to provide breakthroughs, where the size of solved 
benchmark instances has grown by several orders of magnitude, e.g., reaching 
the 24978 cities of Sweden for the TSP. At this point, the two-dimensional 
knapsack instance gcutl3, consisting of 32 rectangles, is beyond the reach 
of the best solution methods by Fekete and Schepers [16] and Caprara and 
Monaci [8]. At the same time, multi-dimensional packing instances are among 
the most popular types of puzzles, sometimes even surrounded by quite a bit 
of hype, e.g., Monckton's "Eternity" tiling puzzle that was the subject of a £ 
1,000,000 prize contest [22]. 

Over the years, a number of benchmark instances for cutting and packing 
have been presented and used in the scientific literature. Beasley's ORLIB 
had a limited number of two-dimensional instances. Wottawa's PACKLIB [32] 
was a first attempt at establishing a general benchmark library for multi- 
dimensional packing. ESICUP [13] started to collect data sets from different 
sources; unfortunately, these instances differ in file format, making it harder 
than neccessary for researchers to facilitate them in their research. 

Other instances were created and used in the context of a variety of research 
papers; see Section 5 for an overview. It should be noted that most of the larger 
instances were originally designed as test instances for other, more restricted 
problems like guillotine cutting. This indicates that even though the capability 
of algorithms for solving instances of multi-dimensional packing problems has 
grown only moderately compared to those for other problems, the development 
of benchmark instances has not kept up. This makes it desirable to establish a 
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collection of harder instances, allowing a basis for comparison and an ongoing 
challenge for further progress. 



4 PackLib 2 

As indicated above, there has been more than one attempt at establishing 
a library of cutting and packing problems. Each of these libraries had their 
advantages and their shortcomings. From the perspective of input, the strong 
point of the ORLIB has been its very simple file format: the description of a 
packing instance is reduced to numbers. On the other hand, this also consti- 
tutes a disadvantage, as a correct parsing of an instance requires reading the 
corresponding article; moreover, despite of its compact representation, OR- 
LIB encoding still contains some redundant information. If a cost is given for 
a box, it is almost always equal to its volume. Other important information 
is omitted from the files. This has lead to modifications of instances: In [8] 
Caprara and Monaci accidentally solve a slight modification of the gcut in- 
stances. The gcut instances do not contain information how many boxes of a 
given type can be packed. So Caprara and Monaci assumed that there was 
only one box of each type. 

The most sophisticated attempt at setting up a cutting and packing library 
in terms of file format has been Wottawa's PACKLIB [32]. Wottawa tried to 
promote a file format that was self-describing. Its drawback was that, at that 
time, it required a rather sophisticated and error-prone parser to read such a 
file. 

As indicated by the name, PackLib 2 is a successor of PACKLIB. Like PACK- 
LIB it employs state-of-the-art technologies for representing cutting and pack- 
ing instances. Unlike all previous attempts, PackLib 2 files not only capture 
instances but also references to creators, references to attempts at solving 
the instances, bibliographic information, and solution data. Because PackLib 2 
is XML-based, the parser for our file format is based on standard technol- 
ogy. As distribution has progressed from electronic mail [4] over ftp-servers 
(possibly dressed in a web interface) [32], we are making full use of current 
cross-referencing possibilities of websites: PackLib 2 is hosted at 

\protect\vrule widthOpt\protect\href {http : //www. math. tu-bs . de/packlib2}{http: // 

As mentioned above, the core of PackLib 2 is a set of XML-based files, one for 
each article listed on the website. Each of these files is subdivided into three 
sections: 

(1) The description section gives general information about the article. This is 



4 



the only mandatory section of a PackLib 2 XML file. This section basically 
is an extension of the BibTeX format. 

(2) If new problem instances or modifications of known instances are de- 
scribed in the article, they are listed in the problem section. 

(3) Finally the results section lists the computational results of the article. 
Whenever we are able to obtain a complete description of the solution, 
the solution itself and resulting images are available on PackLib 2 . 

A detailed and up-to-date description (including future updates and exten- 
sions) of the file format is available on the PackLib 2 website. Based on these 
XML files, the PackLib 2 website is rebuilt (half-) automatically whenever a 
new file is added. This automatism ensures the integrity and comparability of 
the results obtained by different researchers. 

Besides listing instances and results, PackLib 2 also hosts cutting and packing 
software. At this point, a parser for the XML files, as well as converters to an 
ORLib-like format and to the old PackLib format are available. Furthermore 
a program that generates zero-one ILP formulations based on [2] is available. 



5 Description of Data Sets 

In this section we describe the instances that are currently part of PackLib 2 , 
listed in chronological order. So far, all instances are two-dimensional in- 
stances. Most instances presented were originally posed as guillotine cutting 
stock problems. They have been reused in other settings as well. We have 
classified all results using the new typology presented in [31] . 

The oldest and smallest instance was defined by Herz in [19], presenting a 
recursive procedure for the two-dimensional guillotine cutting problem. The 
algorithm was implemented in PL/1 and one hand-crafted instance was solved. 

In 1977 Christofides and Whitlock presented a tree-search algorithm for the 
same problem [9]. They tested their algorithm on 7 instances of the two- 
dimensional guillotine cutting problem. Three of these instances were de- 
scribed explicitly and are part of PackLib 2 . The test problems were randomly 
generated. Given the container Aq with area ao = LqWq, m boxes with area 
ccj were drawn uniformly at random from the interval [0, 0.25aio]. Given these 
areas, the length /j of a box was drawn from the interval [0, ctj] and then 
rounded up to the nearest integer. The width of the boxes was calculated 
by Wi = \a,i/li\. The boxes were then weighted by Vi = r^ai, where r\ is a 
uniformly distributed random number in the range from 1 to 3. 

Another set of instances is due to Bengtsson. In [5] he gave 10 two-dimensional 
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bin-packing problems. For each of the instances he generated 200 boxes with 
length |_12r+lJ and width |_8r+lJ . Here r is drawn from a uniform distribution 
in the range (0,1). Two different containers of width 25 and length 10 and of 
width 10 and height 25 were considered. 

Two practical instances of the constrained two-dimensional cutting stock prob- 
lem taken from applications in the lumber industry were given by Wang in [29]. 
In [2], Beasley introduced 13 randomly generated problems of different sizes. 
Here the length U of each box was generated by sampling an integer from the 
uniform distribution [Lo/4, 3L /4]. The width Wi was drawn from the interval 
[Wo/4, 3W /4]- Lq and W denote width and height of the container. The value 
of the boxes was set to their area. 

In [3] Beasley introduces 12 more packing instances. The procedure for gen- 
erating instances is essentially the same as in [9]. In addition, each box may 
be packed more than once. The maximal count was generated by sampling an 
integer from the uniform distribution [1,3]. 

Hadjiconstantinou and Christofides introduced 12 new data sets for the gen- 
eral, orthogonal, two-dimensional kanpsack problem. They were generated as 
follows. The dimensions k and Wi of the boxes Ri are integers sampled from 
the uniform distributions [l,0.75Wo] and [0.1,0.751^0], respectively. The in- 
teger value Vi was generated by multiplying liWi by a real random number 
drawn from a uniform distribution and rounding up the result to the nearest 
integer. 

PackLib 2 also hosts two randomly generated instances of the two-dimensional 
cutting-stock problem by Tschoke and Holthofer [28]. Five more instances were 
listed explicitly in Hifi's article [20]. In [17] five new two-dimensional knapsack 
instances are defined. They were produced by a method described in [24,25]. 

For the (un)weighted constrained two-dimensional cutting stock problem seven 
problems were given by Cung, Hifi, and Le Cun in [11]. The box sizes U 
and Wi are chosen uniformly at random from the intervals [0.1L , 0.75L ] and 
[O.IW-O; 0.75H / ]- The weight assigned to the boxes is computed by Vi = [p^w,] , 
where p = 1 for the unweighted case and p e [0.25, 0.75] for the weighted case. 

Finally there are the C-instances by Hopper and Turton [21]. These instances 
have 17 to 197 items. Three instances were generated for each problem catogery. 
Width and height of the boxes are produced randomly with a maximum as- 
pect ratio of 7. The problems were constructed such that the optimal solution 
is known in advance. The ratio of the two dimensions of the container varies 
between 1 and 3. 

Many of these instances have been used again and again by other researchers 
to demonstrate the effectiveness of their algorithms. This fact is now traceable 
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through PackLib 2 . 



6 Conclusions 

There are various possible expansions of PackLib 2 . An obvious one is to add 
more instances; contributions are always welcome, especially if they are pro- 
vided with accompanying data, ideally in XML format. Other enhancements 
include two- and three-dimensional problem variations (like including order 
constraints, as suggested in [14]) and the possibility to consider other types of 
objective functions. 

We are also in the process of soliciting practical problem instances from the 
technical computer science community dealing with reconfigurable computing, 
where the objective is to place reconfigurable modules in two-dimensional 
space (on a reconfigurable device like an FPGA) and time (as space may be 
re-used when a module is no longer needed). This means that instances are 
three-dimensional. See [27] for a more detailed description. 

Another upcoming step will be to upgrade PackLib 2 to host more algorithms. 
In the very near future we plan to post the implementation of our leading-edge 
packing code [16,17], as well as meta-heuristic based algorithms to tackle even 
larger instances. Again, constributions are welcome. 
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